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I (57) Abstract 

In a method and a de- 
vice for partial encryption and 
progressive transmission of im- 
age! a first section of the im- 
age file is compressed at reduced 

Mality without decryption and 
a secind section of the image 
file is encrypted. Usershaving 
access to appropnate decryption 
keywords can decrypt this sec- 
ond section. The first section 
together with the decrypted sec- 
<^d section can then be v lC wed 
as a full quality image. The stor- 
age space required for stonng the 
first and section together is es- 
sentially the same as the stor- 
age space required for stonng 
the unencrypted full quahty an- 
sae By using the method ana 
device as described herein stor- 
age and bandwidth requirements 
for partially encrypted images is 
reduced. Furthermore, object 
based composition and process- 
ing of encrypted objects are fa- 
cilitared. .and i ROfa ;can be cn- 



Itnage 
File 




reauccu. ■ »■ 

based composition and process- 

ing of encrypted objects are fa- restored in the compressed domain. 
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A METHOD AND A DEVICE FOR ENCRYPTION OF IMAGES 

"^^on relates t o a method and a device for 
encrypting images. 

BACKGROUND OF THE INVENTION AND PRIOR ART 

BACKGROUND technical field which becomes 

Encryption of digital data information or 

important when transmitting and storing secret 
formation which only shall be available to a user paying for 

information. Thus, several methods for encrypting digital 
Z* m in freguent use. Such methods can also be f *° 

to digital image data. Examples of encryption methods are ' 

triple DES and the public-key RSA method. 

. _ n servers and distributed over a 
Digl tal images can be stored - ™ ^ ^ can also 

telec<-uni=a t ,on network ae^ 9 ^ ^ & 

* dlStribUte ™e d « esclish access control that suits 
Service provider^ context it might be suitable to 
their business model . In this ^ 
o„er partial access to one set o user ^ ^ ^ 

:rten;:rr r :o ^ - — - — - — 

to all image data. 

be offered for sale on the Internet. 
News photograph can e.g. custome rs to download a 

The service provider wanes u 

version of the image with reduced service and 

i-hat want to publish an image, pay t 
journals, that want t y quality image, 

are then allowed to download a full quax 

.nvider wants to minimize storage space 
However, such a service provider wan alterna tively 
and download bit rates. An image *^XTa>-*»* ~- given 
w-t to distribute images on e ^ ^ ^ ^ ^ ^ & 

away or sold for a low price ^ ^ at full 

redU ced guality but theymu t pay^ ^ ^ ^ stQrage 

rprin as efficiently as possible. 
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It is also essential that customers always can access images 
u^ing user friendly, standardise* software. Image probers are 
reluctant to design and support special image viewers and 
customers don't want a proliferation of viewing tools. 

Presently, image providers have to store two versions of the 
images stored. The full quality version is stored as an 
encrypted image file. This means that the image first is 
tossed and stored in a compressed file format such as JPEG 
or GIF. The compressed file is then encrypted using a suitable 
encryption tool «- an encrypted image file is stored The user 
^sffirst decrypt this file and then access the resulting 
compressed image file using an i»age viewing tool Reduced 
ooality images are produced by processing the full ^"y ^ 
Lges in an image editing program. They are stored as separate 
compressed image files. 

problems with this solution are that at least different 
Tof the same image need to be stored, and that both 
" s JLTllsTle transmitted over the networ* in case of 

versions must also be ^ wants to see the free 

remote access in the case a ^ resoluti on 

low resolution xmage before paying j- 

version. 

utilJ significant disadvantage if the reduced 
This results in a signi ^ ^ 

version i»age cental ns a ^ ^ „ journals „u 

information. Images that are o 

in particular » « provr^d fo previe o£ 
sinee journal editors w t £or 

t he image content and accepts y ^ o£ the 

printing. The reduced quality mag 
storage space of the full quality image. 

•„«, still image coding standard JPEG 2000, 

^zz::^z:^ «... — »~ 

which is aescn includes many new 

verification Model «»~^» otter ^ image coding 
£ nnctionalities in ^^ particulax . mech ods for creating a 
"t^oTZ^ i-e formats, each application domain 
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can select a suitable progression mode ^J^f^ 
within images can be accessed separately an the JPEG woo 
bitstreaa, and progressive transmission can be applxed also to 
objects in A ,000 there is also support for independently 
decodable coding units. 

SUMMARY . . „ 

It is an object o£ the present invention to overcome the 
problems as outlined above and in particular to reduce the 
Lount of memory required tor storing an image, which partially 
Xll he possible to view, and also to reduce transmission time 
in a transmission scheme transmitting partially encrypted 
images . 

This object and others are obtained by a technique for partial 
encryption and progressive transmission of images where • 
seccfon of the image file can be decreased at reduced quality 
section o quality image is not 

without decryption, i.e. the first 10 qu , 
encrypted, and where a second section of the image 
encrypted . 

Tta s, users ^ ^ ^^^Z Z 
decrypt this second section. The fir y 
oacrypted second section can h^ vie ^ ^ ^ 

image. The storage space requir ^ ^ 

re quired for section My , depen ding on the 

encryption of the secon o£ the second 

encryption method, imply a sngnc f .._, iQn 
Tctfon cohered to the unencrypted second section. 

can also be partitioned into multiple sections where 
The image can also be P individual encryption 

each section may be encrypted with encrypted. 
m ethod and Keyword, -e sections^ ma^ be st^ ^ 
ftn important element of the method M o£ 
herein is that the compressed images con ist jf ^ 
independently decodable ceding « t « • ^ 

possible to --^^rjy "odin,. 
domain without performing entropy 
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X .educed quality ^ can be produced according to several 
different main schemes, such as: 

1) Reduced resolution 

2) Reduced accuracy of the transform coefficients 

3) Llusion of predefined regions of interest (ROD 

TtieS e methods can be combined so that a reduced quality image is 
These mecQou -resolution and the accuracy 

e.g. produced by reducing both the resolution an 

of the transform coefficients. 

w using the method and device for storing and transmitting 
ilage data as described herein, several advantages are obtained. 

there is no need to store two different versrons of an 
i!a™ U different users are to have access to different qualrty 
Tthe one Ld same image. Also, transmission times become much 
of tne one cuiu ^ , low resolution, 

-information content of the first, iow 
'CI dltl canTe Reused when transmitting the higher resolution 

image data . 

—jSrZZZZZZZ described in more detail and 
lith reference to the accompanying drawings, in wbrch. 

•neral view of the file structure of an image. 
" ;r 9s \raLTrhowrencryption of images coded according to 

^iH - a Tl^rt illustrating some steps carried out 
"Tstdirgrrfllustrating a client server process. 
- Pig. 5 is a view of an encryption header 

DETAILED DESCRIPTION struct ure of an original, 

in Pig. 1. a general vrew of the fx ^ fii> 

hig h resolution, image „ : ^ inds ^ eMly decodable coding 
consists of a number £ile structure shown in Pig. 

actions 101. »3 and 105. in t version o£ a high 

11 ^ ^^"istoTed Without encryption and will therefore 
^e^code by any receiver. 
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„. n 1Q3 which comprises data, which combined with the 
rta Se of section,^ result in a medium resolution version of 
TXi^ rZ^ is encrypted usin g a first encrypts 

"ethoa and only receivers having access to the correct 

Key *e ahle to decode the data stored m the 

section 103 . 

The section 105, which comprises data, which combined with the 
Z* of section 1.1 and 103 results in a full resolution version 
Tt the high resolution image, is encrypted using a second 
action method, and only receivers having access to the 
encryption Key will he ahle to decode the data stored in the 
section 105. 

Thus, decoding o £ the section doling of the 

decoding of the sectxo full resolution image 

from the sections 101 and 103 result in a full 

115. 

^hermore. implementation in ^ ^ a ^^Z 
«■ ^ - cZ unit o £ the » 

ro^rrcan rs— - - - ttet a wide 

r ^e of progressive modes can he supported. 

a n o n a coding unit is a part of 
ta « 2 000 -" i ^ i -;: d :^ cl : c a b t°tplane of a given 
the bitstream that encodes a specr described as any 

suhband. in general, a ^^^^Uion. The general 
^endently ^ - - ^ " 

su «icient to -r ^^ in C he header that 

nsr=£ = - r savin9 tbe bits ttec 

are needed for inserting explicit tags. 
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in Figs. 2a and 2b bio* diagrams describing how ancryption can 
be implemented in tbe JPEG 2000 encoder and decoder 
respectively, are shown. 

Tbus in Fig 2a a block diagram where encryption is performed 
I^er entropy coding in tbe encoder is shown, coding unrts enter 
In entropy elding block 201. In the block 20! coding the coding 
units arfentropy coded nsing some suitable -ropy code^ The 
output from the block 201 is fed to a selector whrch selects a 
ou p foT . each entropy coded coding unit, 

suitable encryption method for each entropy 

some coding units can be selected to not be encrypted at all. 

in response to the selection made in the selector 203 the 
entropy coded coding units are encrypted in a bloc, 205 Jb. 
encrypted coding units together with the not encrypted coding 
unilf then form a combined output data stream, which can be 
stored or transmitted. 

in Fig 2b a decoder for decoding the bit stream generated by 
in Fig. 2h a t encrypted ^ not 

which selects receiv ed coding unit is not 

coded coding unit, or if tne rece 

encrypted it is directly transmitted to a block 255. 

te , he selection made in the selector 255 tbe 
" reSP ° n ld ceding -its are decrypted in a block 253 usxng a 
entropy coded coding decrypted coding units are 

suitable -cryption a igorr thm. rh ^ ^ ^ 

then fed to the 251 ^ £r0 m tbe decryption 

from fed directly from the sei.ee combi „ed 
blo ck 253 are antropy decoded and «-*^ ° „ hich is £e d 

output data stream corresponding to tbe data 
to the entropy coding block 20! rn Frg. 2a. 

• th . transmission scheme as shown in tbe 
Each coding unit m th « independe ntly encrypted block. 

Fi3 s. 2a and 2b is handled - sep arately with any user 

E ach coding unit can also be encryp ^ ^ ^ 

rren^Terwir-erlt encryption methods. T he 
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encryption method used can further be an encryption algorithm 
coined with a Xeyword or a method £ or generating Keywords. 

Afferent encryption methods can in such an embodiment have 
SSL asthma but different ^J^^ 

to specify the Encryption Method. Unit Encryption State (OSS) « 
a symbol that for each coding unit defines how it is encrypted. 

In Pig 3, a flow chart illustrating different steps carried out 
when encrypting an image are shown. First, in a step 301, an 
^geToTe Partially encrypted is received. The image received 
TsteP 301 is then coded using a coding algorithm generating 
i^ependently decodahle coding units, e.g. 0»0 -00. rn a step 



303. 



st „ 305 s ome of the coding units of the image coded 
303 are encrypted using some suitable encryption method. 
" I Z The cX units that are chosen to be encrypted 
such as DES. The coamg nrefprenC es Thus, a user can 

v. o-i- in accordance with user preferences, 
can be set in accoiuau hiaher order 

. haw codinq units corresponding to ROIs, hign 
chose to have coding un encrypted coding units 

Dit -planes, etc, encrypted. are merged into a 

and the coding units which are not encrypt 
single bit stream. 

uh en transmitting an ima 9 e .^ C shown . T nus. a client 

.escribed in con jU n=tron « * ^ ^ _ then issue 

:°u"orards co th: u « - . — < step 



405 



.03 replies by transmitting the coding units of the 
The server 403 replies y ^ encrypC ed 

inage which are not -crypted uU1 ha ve 

ooding units can be decoded by the cl ^ ^ 

acC ess to a low reso « «« - P ^ ^ access to 

Based on this """ZZZSZ the Y full image. Xf so the 
the image in a higher resoxu 
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client transmits a request to the server requesting such 
information, step 409. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the 
higher resolution version of the image, step 411. If the client 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the cost for the image the 
server sends the encrypted coding units together with a key word 
by means of which the encrypted coding units can be decrypted, 

step 415 A secure method for key distribution should be used. 

Exan.pies of such secure methods are described in W. Stalling 

-Data and computer Communications", p 635 -637, Prentxce-Hall 

1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and 
encrypted coding units, for example if he has purchased a CD-ROM 
"^images coded as described herein. The scheme as descried 
in conjunction can be modified so that no image data is 
transmitted. Instead the client only agrees to conditions set by 
transmitted, x word(s) which are 

the server in order to have access to the key wor i 
required to decrypt the encrypted coding units of the CD ROM. 

r t-ha case when the method and device as described herein is 
in the case when accoraing to the JPEG 2000 standard, it 

used when encoding does QOt standardise 

is advantageous if the JPEG ^ ^ ^ ^ 

e^tior >-^££ y *Z Hncryption Tag that is merged with 
^ 9 JPEG Too Ta^s can instead be used to specify how coding 
units are decrypted. 

In such an ^l»t the JPEG 2000 i-age header contains an 
i n such an Mt i£ My cod . ng mlt 1S 

^ r ^ L ^ion Header <EH, should then he appended to 

optionally he merged into JPEG 2000 Tags. 

*■ s an encryption header is shown. The Encryption Header 
TJZ'LTr^^ contain the allowing sy^hols. 
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1) Encryption Mode (EM) . A set of standard encryption modes are 
defined e.g. 

a) One encryption method is used for all coding units 

b) Bitplanes of less significance than bitplane X are encrypted 

c) subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

No encryption information need to included in the Tags if an EM 
is defined. 

2) Encryption Mode Parameters (BMP). Parameters (X, Y. ...) that 
are used to define the Encryption Mode are set here. 

3) Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

*r~«->,«ri n^scriDtor (EMD) for each encryption 

4) One Encryption Method Descriptor _ 

method The EMD defines any data that is needed by the 

• v* v for decrypting the enclosed encrypted key. The 

private key for dec ^* * decryption algorithm to decrypt 

decrypted key is ^\ J^ J th 7l^s alloC ates an number to 
image coding units. The order of the emd symbo ls. 

^ H T v.4 s number is used in ue.^ s y iuuu 
each encryption method. Tms numu 

for- each coding unit specify if it 1S 
5) The bitstream must for each co g ^ 

encrypted and if so by what method. This is a y 
encryp svm bol per coding unit. These 

Onit ^^7.^; b OT co ilecTed in the encryption header or 
symbols could either be coliecce encryption 
alternatively be distributed in tne ^ _„„^ tion header we 

tags. It the UES information is Kept » the encrvP ^ 
«i- a header eie^ent - "^"^ same order as the 
a series of DES synbols that are lrsted in tne 
coding units appears in the hit stream. 

IF EF is set and tne Encryption State is not given in the 
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>, ade r JPEG 2000 Tags can be expanded to contain Unit 
r^iol state cue!) symbols. UBS defines which encryption 
Z Z\L is nsed for encrypting the next coding 

unit . 

belonqing to a ROI can be handled as 

^ "T^ZTX « .Tc^et.ly or partially encrypted 
described ebove T^ey can ^ ^ ^ ^ 

by selecting appropriate cocxng 

encryption. 

T he main problem is that the shape of the ROI might reveal^ 
content. If the shapes are encrypted it is, however difficult 
to show a reduced quality image since xt xs dxffxcult to 
interpret the coded transform coefficients. 

w. m ran be solved by defining a so called cloaking 

=r- ~ ru* - ■ - 

shape is a bounding box. 

. , s treat ed as one single ROI in the JPEG 2000 bit 
X c-shape is "j^f withQUt encryp tion as descrxbed xn 

stream. The c-shape xs cod Verific ation Model 

Charilaos Chrxstopoulos (edJ, deS cribed therein 



header . 



. . _ <, haDe and the transform 
X mask is created us^ ^ ^ ^ 

coefficients belongxng to the c P ^ fchat 

using the method as descrxbed herexn ^ 
all coefficients belongxng to any ^ ^ thus 

by the c-shape are encrypted. The tex 
protected by encryption. 

enrrvDt ed and stored e.g. in the 

«- — ot c r t::* — « * ° inters chat 

encryption header. The en ryp correspoodi „g c-shepe. 

encrypted « = ^ bactgromd . TS e c 
The decoder can now u« 
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shab e can be displayed as a blanr region. The original MX. « 
TdlcoTed if the Keyword is Known. This is done by ™^ 
the coefficients belonging bo the c-shape. The shape of each ROI 
^ olging bo bhe c-shape is also decrypted. The bit™ can 
„L be rearranged so that the c-shape is dropped and the 
Z£ZZt aata structures are restored. Hote that this is 
done in the compressed domain. 

The .as, that is used for encoding a ROI is not 
in JPEG 2000. A mas* that is sufficiently large so that «*■»« 
is encoded lossless -ill often cover the whole lower subbands . A 
^asfc that is not allowed to expand will lead to a lossy encoding 
" the ROI. The masKs belonging to different ROIs or to a ROT 
and the background can be designed to overlap. This means that 
see coefficients are encoded in more than one ROI. Such^ 

•n i..d to a reduced overall compression but the ROls 
overlap will lead to a reou accessed and decoded 

are more independent so that any ROI can be accessed 

with a good visual result. 

^ ^ <=^r- pots described herein is not 
rae partial "g as the mas, is selected 

dependent of th <f^ e ° cajmob be re00 nstru=ted from the 
so that the content of^a RO r meChod £or building a 

content of any other ROI or g describea in charilaos 

^ .hat hides the conten -ROI^ ^ ^ ^ 

Christopoulos (ed.), 

>. „„ rt device as described herein storage and 
By using the £™ ti ^ y encrypted images is 

bandwidth "^"^ based composition and processing of 
"duced. Furthermore, R0IS can be encrypted, 

encrypted obje ct s are f cUltat e^^ ^ ^ 

reottanrrc^d and restored in the compressed domain. 

„r advantage is ^^^tT^^ 
performed at the same « -n« ^ g ^ ^ 

che process taKes plac * ^ ^ imaaes witto ut 

bitstream syntax) iti P £otlnea just before 

encryption. The encryption can P „ this ca3 e, 

transmitting the image by a parser 

SOBSTTTVrre SHEET (RULE 26) 
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Ureases the bitrate, which will be the case 
if the encryption xncreases th ^ ^ 

if the encryption is placed in en ^ 
is avoided and the encryption information is only 

transmitting it- 
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CLAIMS 

!. A method of partially encrypting inage data comprising the 

!Tdin, ! tne ^ data using an encoding algorithm generating 
independently decodable coding unite. 

- encrypting at least one o£ the coding units, and 

- ^ng cidin, units which are not encrypted with coding units 
which are encrypted into a combined bitstream. 

2 a method according to claim 1. characterised in that the not 
encrypted coding units correspond to a low resolution version of 
the image data. 

3 A method according to any of claims 1 - 2, -"f-f" 1 "*** 
Lt different coding units are encrypted using different coding 

methods . 

« A method according to any of claims 1-3, eharact erUed in 
It an encryption flag, which indicates if a coding unit 
encrypted, is inserted in the bit stream. 

s . a method according to any of claims 1 - 4.*- formation 
„f fla Reaion of interest is encrypted, 

enclosed in a cloaking shape. 

.. A device for partial encryption of image data characterised 

"means for coding the ^^rj^ 
^TJZ^ r=T2- - encrypting at least 
one of the coding units, *r* ancr ypted with 

-JT ^-"ST rented, as a combined bitstream. 

4- „i*vm 6 characterized by means for 
7 . X device aCC ° rdin !^! t C ' .nits as units corresponding 

electing the not encrypted coding 
t: 1 : Xow resolution version of the image data. 
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, - X device according to any of claims 6-7, «>«"»™ * 
tJL ror-encrypting =i«— — i-. -its using afferent 
coding methods. 

, X device accord^ to any of claims 6-8, f"»«- * 

for insert*,, en encryption flag, wnicn indicates if a 
coding unit is encrypted, in tne bit stream. 

10 ft Qevlce according to any of claims 6-9, characterised by 
^ Z enclosing e region of interest shape in a cloahmg 
shape . 
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